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TITLE OF THE INVENTION 

Method for Determining Measurement Error for Gene Expression 
Microarrays. 

CROSS-REFERENCE TO RELATED APPLICATIONS 

5 This application claims the benefit of U.S. Provisional Patent Application 

No. 60/233,547, filed September 19, 2000, the contents of which are hereby 
incorporated by reference for all purposes. 

STATEMENT REGARDING FEDERALLY SPONSORED RESEARCH 

The United States Government has rights in this invention pursuant to 

10 Contract No. P42 ES 04699 between the National Institute of Environmental Health 
Sciences and the University of Cahfomia. 
FIELD OF THE INVENTION 

The invention relates to the field of error analysis, and more specifically to 
analysis of errors in the measurement of nucleic acid array data. 

1 5 BACKGROUND OF THE INVENTION 

The human genome project will, at its conclusion, provide a complete 
description of the entire human genome sequence. Applications of such sequence 
information to diagnostics, prognostication, and basic research problems already are 
occurring. In addition to genomic sequence information becoming available through 

20 the efforts of gene sequencers working under the auspices of the human genome 
project, cDNA sequences also are widely available. Such sequences represent 
expressed genes actively transcribed and translated in cells. High density 
oligonucleotide arrays, such as the GeneChip(g' arrays manufactured by Affymetrix, 
can be manufactured once genomic or cDNA sequences are determined. These and 

25 other similar arrays provide a convenient way to sequence genomic DNA from an 

individual {i.e., to genotype) and to monitor gene expression. The data produced by 
hybridizing samples to these and other similar arrays allows scientists and clinicians 
to accomplish a number of objectives. For example, the developing field of 
pharmacogenomics relies on correlations made between drug response and genotype, 

30 enabling clinicians to predict which drug will best work in a patient. Similarly, by 
analyzing cDNA expression patterns, clinicians are improvmg their ability to 
distinguish among closely related diagnoses, and to monitor patient response to drug 
therapy. 
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Thus, DNA microarray technology has rapidly revolutionized research in the 
biological and medical fields. In the case of cDNA microarrays, the strength of the 
technology lies in its ability to allow the simultaneous monitoring of thousands of 
gene expressions in a single experiment (i.e., in a single sample). Applications to 
5 cancer research (DeRisi et al., Dec. 1996, Hilsenbeck et al., Jan 1999), acute leukemia 
(Golub et al., Oct. 1999), lymphoma (Ash et al., Feb. 2000), human cancer cell lines 
(Ross et al., March 2000), and colon tissues (Alon et al., June 1999) are some 
examples. Due to the explosion of the uses of microarrays, continued attempts to 
address management (Ermolaeva et al., Sept. 1998) and analysis (Chen et al., Oct 

10 1997, Eisen et al., Dec. 1998, Newton et al., 2000) of gene expression data are 

needed. The present invention addresses the need for improved methods for analysis 
of microarray-derived gene expression data by providing methods for determining the 
precision of such data over the full range of observed expression levels. While the 
methods are described with specific reference to expression arrays, they are equally 

1 5 applicable to other data having similar structure, as described below. 
BRIEF SUMMARY OF THE INVENTION 

Methods are provided for determining the precision of data obtained from 
nucleic acid arrays, including gene expression microarrays, over a range of signal 
levels. The data are analyzed according to the following model: 

20 y ^ a-\- jue" + e Equation 1 

where V is the observed intensity measurement, \i is the expression level in arbitrary 
units, a is the mean background (mean intensity of unexpressed genes), the 
proportional error that always exists, but is noticeable at concentrations significantly 
above zero, and c, represents an additive error that always exists, but is noticeable 

25 mainly for near-zero concentrations. 

One aspect of the method involves application of a thresholding algorithm to 
identify the set of data comprising 'iow" signal level data, i.e., data with observed 
signal intensities below a threshold cutoff determined according to the thresholding 
algorithm. Two parameters are estimated from this set of data. One is a, 

30 corresponding to the above-described mean background intensity (i.e., the mean 
intensity of unexpressed genes) The other is the standard deviation, , of the 

additive error, £, that is always present, but is noticeable mainly for near-zero 
concentrations. These parameters may be estimated even in the absence of replicate 
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measurements. Alternatively, a and may be estimated from negative control 

experiments, i.e., replicate blanks. 

Replicated measurements of high expression level signals {i.e., measurements 
for which the variance of the logarithms of the signal is approximately constant) are 
5 used to estimate a^^. 

The present invention uses these parameters to provide estimates of the 
variance of the measured intensity, and other statistical measures such as confidence 
limits of the expression levels, expressed in arbitrary units. 
DESCRIPTION OF THE DRAWINGS 
10 Figure 1 illustrates cutoff points for 72 arrays. 

Figure 2 illustrates expression values in a single array with horizontal line 
showing cutoff point at convergence of thresholding algorithm. 

Figure 3 is a Table illustrating cutoff points at convergence. 
DETAILED DESCRIPTION OF PREFERRED EMBODIMENTS 
15 1. INTRODUCTION 

Just as with any other analytical technology, measurement of gene expression 
with cDNA or other oligonucleotide arrays have associated measurement errors. It is 
commonly observed that the standard deviation of measurements rises in proportion 
to the expression level. However, this proportionality cannot continue down to genes 
20 that are entirely unexpressed because that would imply zero measurement error, 

which is not observed. The model proposed in this patent (Equation 1) originally was 
developed in the context of instrumental methods of analytical chemistry, because 
these methods also exhibit the same kind of behavior referenced above (Rocke and 
Lorenzato, 1995). 

25 The model used in the present invention resolves the difficulties of 

determining cDNA expression level measurement errors by incorporating both types 
of error observed in practice into a single model. The model provides advantages 
over existing models by describing the precision of measurements across the entire 
usable range of observed signal intensities. Applications of the model developed in 

30 the present invention pertain to detection limits, categorization of genes as expressed 
or unexpressed, comparison of gene expression under different conditions, sample 
size calculations, construction of confidence intervals, and transfonnation of 
expression data for use in multivariate applications such as classification or clustering. 
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2. THE MODEL 

Most measurement technologies require a linear calibration curve to estimate 
the actual concentration of an analyte in a sample for a given response. We can 
incorporate into the linear calibration model the two types of errors that are observed 
5 in most analyses. The two-component model for analytical methods such as gas 
chromatography/mass spectrometry ("GC/MS'') is: 



random variable that is normally distributed around a mean of zero, and that has a 
variance, crl). Here, // represents the proportional error that always exits, but is 

noticeable at concentrations significantly above zero, and c represents the additive 
error that always exists but is noticeable mainly for near-zero concentrations, [i 

1 5 represents a slope factor that relates response, v, to concentration, //, and can be 
determined through the use of a calibration curve constructed using standards of 
known concentration, a represents mean background, i.e., the mean response, i', 
obtained by running blanks through the analysis system. This two-component model 
approximates a constant standard deviation for very low concentrations and 

20 approximates a constant relative standard deviation ("'RSD") for higher 
concentrations. 

For gene expression arrays, it is unusual to have calibration data (that is 
samples of known expression levels), since constructing a spiked sample for 
thousands of genes would be prohibitively complex. Thus, we cannot actually discern 
25 the expression level in molecular units, but can only do so relatively. The model for 
gene expression arrays therefore looks like this: 



where v is the intensity measurement, ja is the expression level in arbitrary units, a is 
the mean background (mean intensity of unexpressed genes), r] is the proportional 
30 error that always exists, but is noticeable at expression levels significantly above zero, 
and s represents the additive error that always exists but is noticeable mainly for near- 
zero expression levels. 



y - a ^ Pjje^ 



Equation 2 



where V is the response of the measuring apparatus (such as peak area) at 
concentration r(- 7V(0, cr^^ ) {i.e., // is a random variable that is normally distributed 

1 0 around a mean of zero, and that has a variance, cr^^ ), and e - A^(0, al ) {i.e., s is a 



y — a -\- i^ie^ ^-^ 



Equation 1 
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Under this model, the variance of the response at concentration ju is given 

by: 

Kar{v} = //'e"^' (^"'' -ij+^j' Equation 3 

(Rocke and Lorenzato 1995). A derived quantity will be useful in interpretation of 

5 the results. S^^ = ^le^^f^^\) Equation 4 

S^^ is the approximate relative standard deviation (''RSD'') oiy for high levels. 
Using this derived quantity, we can represent the variance of y as 

Var{jv'} = iu~S^^ -h a; Equation 5 

3. ESTIMATION 

1 0 The parameters in the two-component model can be estimated in a number of 

ways. The easiest way to estimate the standard deviation of the low level 
measurements is from replicate blanks (negative controls). Data are generated using 
an array identical to the array on which samples will be run, and a blank (comprising 
components identical to the sample components in all ways except for the presence of 

1 5 sample nucleic acid, which is omitted from the blank) is loaded onto the array, and 
processed in a manner identical to the procedures used with an actual sample. In 
some instances, it is possible to use the same array sequentially for obtaining negative 
control and sample data. For example, if processing the array used for the negative 
control does not impair the ability to obtain data from a subsequently run sample, then 

20 the same array can be used for the negative control and the sample. Of course, this 

procedure will be of value only if the data obtained from the subsequently run sample 
is statistically the same as the sample data that would have been obtained had the 
negative control not first been run on the array. 

One of ordinary skill will readily appreciate how to evaluate whether first 

25 running a negative control alters the subsequently obtained sample data in a 

statistically significant manner. By way of example, an experiment can be set up 
using two sets of arrays that are purported to be identical {i.e., arrays from a single 
manufacturing lot). One set is used to generate sample data without pre-running a 
negative control on the arrays, while the other set is used to generate negative control 

30 data, and then, on the same arrays, to generate sample data. If pre-running negative 
controls on the arrays does not impair the ability to obtain data from a subsequently 
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run sample, then comparisons of the intensity levels between the two sets should 
reveal that they are statistically unchanged from each other. 

The standard deviation of the negative controls is an estimate of . The 
mean intensity of the negative controls is a suitable estimate of a, the mean 
5 background. In the next section, we present a method of estimating a and even 
from unreplicated data through the use of thresholding algorithms. The parameter cr,^ 

can be likewise estimated from the standard deviation of the logarithm of high level 
replicated measurements. High level measurements may be assumed to be the highest 
intensity measurements, i.e., the set of the several highest intensity measurements. As 

10 described below, the set of high level measurements is characterized by the fact that 
the variance of the logarithms of these measurements is constant. This 
characterization may be used to check whether a set of replicated measurements 
should be included within the set of high level measurements. Ideally, such replicated 
measurements arise from identical probe areas on a single chip, although, as described 

1 5 below, such replicated measurements might be obtained through the use of a plurality 
of chips run with identical samples, provided that appropriate scaling is used to 
normalize the intensities among the plurality of chips. 

For each replicated gene that is expressed at a high level, compute the standard 
deviation Sf of the logarithm of the replicates. If there are m replicated genes, one then 

20 pools these estimates as follows: 




Equation 6 



where is the number of replicates for gene / and 



m 



/2 = ^ Equation 7 



The parameter, s. obtained from Equation 6 is an estimate of a,;. Thus, S,^ can 
25 be estimated by squaring s, obtained from Equation 6, and substituting in place of 
<T^^ in Equation 4. 

This method of estimating a^^ works because for high expression levels. Equation 1 is 



indistinguishable from 



Equation 8 



30 



ln(v) = ln(|i) + ri 



Equation 9 



21 37251 9. 1 /1 9629-7006 



-6- 




Patent 

Docket No. 19629-7006 



which is a constant mean, constant variance model. 

There is no method even in principle for estimating measurement error 
without at least some replication at high levels since it is impossible from an 
unrcplicated sample to know if an intensity value is high because the expression is 
high or because of a positive measurement error. This fact of life should be an 
important determinant of experimental design in microarrays. 

If there are no negative controls, a^- can be estimated by pooling the variance 
estimates of genes that have low expression levels. For this, one would use the raw 
expression values and not the logarithms. The definition of high and low expression 
is, of course, dependent on the values of the parameters <T^~and 5,^ For example, the 

variance of v given by Equation 5 can be compared with the variance of v at low 
expression levels, where the primary source of variance derives from the variance of 
the additive error component, i.e., cr^~. We can define a threshold expression level for 
low-level expression as that expression level at which at least 90% of the observed 
variance in j' arises out of the variance of the additive error component, /.e, cr^:. 
Mathematically, this can be expressed as follows: 



>0.9 



Equation 10 



Cross multiplying Equation 10 gives rise to: 

a] >0.9a; +0,9//'^,; 

Collecting similar terms and dividing through by 0.9 S^^ yields: 



Equation 1 1 




Equation 12 



Taking the square root of the Equation 12 gives us: 



Equation 13 



Thus, one can define "low-lever' data as those data where the observed 
expression, is less than or equal to the threshold defined as cr^./3S^^ . 
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Similarly, "high-level" data can be defined according to a threshold above 
which at least 90% of the observed variance in v arises from the variance of the 
proportional error component, i.e., JL^ S^^ . This is mathematically expressed as: 

— ^ — ^— ^ > 0.9 Equation 14 

5 Using the same algebraic re-arrangements as described above, we arrive at the 
threshold for high-level data as follows: 

ju'Sl > 0.9a; +0.9//'^,; Equation 15 

. 0.9cr; ^ . 

u~ > ^ Equation 16 

0.15,; 

jU > 3a /S^^ Equation 17 

10 Thus, one can define "high-level" data as ones where the observed expression, 

equals or exceeds the threshold defined as 3a^, /S^^ Note that once an estimate 

has been obtained for S^^ from the an initial set of high level replicated measurements, 

the high-level threshold Equation 1 7 can be used to check whether each replicate 
comprising the set exceeded the threshold. If some of the data are found to be below 
15 the threshold, they can be discarded from the set, s and S^^ can be recalculated and the 

new data set used to calculate these parameters can be rechecked against Equation 17. 
This procedure can be iterated until each member of the set of high level replicated 
measurements meets or exceeds the high-level threshold as set out in Equation 1 7. 

As an example, suppose that the background had mean a =10 and standard 
20 deviation a^ = \ , and the high level coefficient of variation, S^^ =0.1. Then, 

applying Equation 13 we obtain the threshold of low-level measurements, for which 
the standard deviation would be approximately constant, as those measurements for 
which the expression level //_<(1)/(3)(0.1) = 3.33 (i.e., |a < 3.33), corresponding to 
intensity values less than or equal to 13.33 (i.e., the background, a, plus ju). Note that 
25 this is slightly greater than three standard deviations of the background above mean 
background; /.e. 3 cr^ +a = (3)(1) + 10 = 13. 

High-level measurements, corresponding to measurements with nearly 
constant coefficient of variation, for which logarithms should stabilize the variance, 
are those for which the conditions of Equation 17 apply, i.e., ju > 3 a^ Sr\ = 
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(3)(1)/(0.1) = 30 {i.e. ju > 30), corresponding to intensities greater than or equal to 40. 
In the range 13.33 to 40, both the variance and the coefficient of variation are 
changing drastically. 

For data with calibration curves, the most effective estimation method is 
5 maximum likelihood, as described in Rocke & Lorenzato (1995), but the more 
heuristic methods alluded to above may be satisfactory for many applications. 
4. ESTIMATION OF BACKGROUND WITHOUT REPLICATION 

According to Equation 1, intensity measurements from unexpressed genes will 
be normally distributed with mean a and standard deviation cr^ , If there were a 

10 defined set of negative controls, then their mean and standard deviation would be 
estimates of these parameters. In the absence of negative controls, the following 
thresholding algorithm procedures are recommended. The algorithms may be used in 
conjunction with some current data preprocessing and thresholding. The algorithms 
converge to a '^cutoff point'' for p gene expressions on a given array. The analyst can 

1 5 then decide to analyze genes with expression measurements above this cutoff point, or 
use the information from the algorithms for array rescaling. 

The use of thresholding is common in the analysis of gene expression data. 
For example, gene expression levels that fall below a certain threshold level are 
deleted from analysis; this may be justified under some prior knowledge about the 

20 experimental procedure, otherwise such practice is arbitrary. It is also common 

practice to discard negative measurements (which occurs when a spot background 
noise measurement exceeds the signal intensity). Although negative measurements 
( due to imperfect measurement technology) should not be used in the analysis of gene 
expression, this information can be used to estimate the array-specific noise for 

25 rescaling. It also has been suggested that genes exhibiting at least k-fo\d {e.g., 3-fold) 
changes in differential expressions in cDNA arrays {i.e., comparing expression 
between two different samples) are deemed significant and such rules appear 
somewhat arbitrary as well. A study of differential variability of expression ratios 
suggests some alternatives (Newton et al., 2000). The described thresholding 

30 algorithms find a "cutoff point for each array (hence accounting for different levels 
of noise specific to individual arrays). Genes with expression levels below the cutoff 
point may be considered unreliable or this information can be used as an estimate of 
''noise' for that particular array; an estimate of array-specific noise can also be used to 
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scale the arrays. Scaling can be used to provide '^replicated" data sets when aliquots 
of a sample are run on a plurality of arrays. As described above, such replicated data 
currently are needed to provide estimates of a^^ . 

The thresholding algorithms have two parameters: (a) the percentage {q) of the 
5 smallest expression values in the array to form the initial set, and (b) the number of 
standard deviations, a, or median absolute deviations (MAD) above the mean or 
median to determine the cutoff point. We refer to the second parameter as (c). These 
thresholding algorithms can be applied separately for treatment and control in a two- 
color array. The algorithms are robust to outlying observations, and are not sensitive 
10 to the first parameter, q. A general description of the algorithms follows, starting with 
the algorithm that uses the mean and standard deviation to compute the cutoff point. 

1 . Begin with a small subset of genes with low intensity, such as ^ = the 10% 
of genes with lowest intensity measurements. Compute the mean /ub and 
the standard deviation a^of these genes. 
1 5 2. Define a new subset consisting of genes whose intensity values are no 

larger than ju/^ + 3 a/^ (i.e. c = 3). Recompute jub and a^. 
3. Repeat the previous step until the set of genes does not change. 
At the final step, the set of genes should include at least 99.9% of the 
unexpressed genes. Depending on the distribution of actual expression levels, this 
20 estimate could be biased up both in mean and the standard deviation, because it is 

impossible in principle to distinguish an unexpressed gene from one with such a low 
expression level that it is below detection limits. Nonetheless, this estimate should be 
of considerable use in screening genes for expression. 

The MAD-based variant of this procedure may reduce the bias somewhat. In 
25 this variant, one uses the median of the expression levels of the subset of genes as the 
estimate of location, and uses MAD/0.6745 as the estimate of (Tb, where the MAD is 
the median absolute deviation from the median. This is calculated by subtracting the 
median from each expression value in the subset, taking absolute values, and taking 
the median of the resultant set of absolute deviations. 
30 A more formal mathematical description of the MAD-based variant is 

described below. Of course, this description also pertains to the mean and standard- 
deviation based algorithm, by substituting the mean for the median, and the standard 
deviation, a, for the MAD. 
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Let the original gene expression values for the /th array be xi, a'2, . . - , Xp and / 
= 1 , 2, . . . , is the number of arrays. For brevity of notation denote the collection of 

expression values for array / by {x • }^ ^ and assume that these values are sorted 

5 5. PARAMETERS ^ AND c 

1 . Select a percentage, q% of the total number of genes, having the lowest 
expression values. Denote this initial set of values by ^ {-Vi, X2, . . . , 

2. Calculate the median of the initial set, nio = median (x . }"'^^ . 

10 3. Calculate the median of the absolute deviations about the median, 

MADo ^ median |a-^ - /",,|}' ^ , of the initial set of values Aq, 

4. Calculate the cutoff point, uq = MADq + c x 5o, where ^ MADo/0,6745 
and c = 2, 2.5, or 3 (i.e., the number of median absolute deviations above 
the median). 

15 5. Determine the new set defined hy A\ = {all xj < wo}* 

6. Repeat steps 2 through 5 (for each new set Af,) and stop when = f^kA 
(convergence). At convergence denote the set of expression levels by 

(with size /;,) and the cutoff point by {i = \ , 2, . . . , TV). 

7. Repeat steps 1 through 6 for each array, / = 1, . . . , TV. 

20 In constructing the sets A^s we have used the median and MAD (median 

absolute deviation from the median) which are robust measures of location and 
dispersion, respectively. These measures are less affected by ''extreme" observations. 
A measure of dispersion analogous to the well known sample standard deviation (a) is 
s ^ MAD/0.675. However, the latter is a robust estimate and measures the dispersion 

25 of the central portion of data; the sample standard deviation may be heavily 

influenced by outliers, depending on the magnitude of the deviation of the outliers 
from the sample mean. This parameter, 5, was used to determine the upper limit ii = 
m + c X 5 in the algorithm (where m is the median). At convergence, the smallest /7, 
values of array / are selected as ''noise" values. Estimates of the mean or median 

30 array-specific noise can be obtained by taking the sample mean or median of the set 
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A^^ for array /, Of course, any other statistics based on A^^ also may be used to 
estimate array-specific noise. 

6. APPLICATIONS OF THE THRESHOLDING ALGORITHMS 

As an illustration, one can use /i„ to rescale the expression levels in array /'. 

5 Suppose that the mean of ^„ , x. = ^a,. / fi.{i = 1, 2, . . . , iV) is used. One may 

consider (a) multiplicative rescaling: x/j <~ Xijuu or (b) subtractive rescaling: Xy <— x/j - 
a„ where m, = x. I x- , and x- is the overall mean of the /th array. Other scaling 
choices are certainly possible. For an array with high average noise, using strategy (a) 
the rescaled expression measurements would be smaller relative to the expression 

1 0 values of another array with lower average noise (and similar overall average 
expression). Even baseline or control arrays are susceptible to errors since 
measurements come from the same system; hence, the algorithm can be applied here 
as well. As indicated above, such rescaling can be used to combine data from 
different arrays, and in instances in which aliquots of the same sample are run on a 

1 5 plurality of identical arrays, the combined data can be used to generate the replicate 
measurements needed to estimate a^^ . 

Some natural questions arise regarding the parameters {q and c) of the 
thresholding algorithms described above. For instance, one may specify that 10% {q 
10) of the expression values of the /th array be used to form the initial set Aq. Will 
20 the set at convergence A^^ be the same if q is changed, i.e,, the initial set A^ is 

changed? We provide some evidence to support that the sets A^^s at convergence is 

insensitive to the starting percentage q. Golub et al. (1999) considered molecular 
classification of acute leukemia based on a 38 samples training dataset and a 34 
samples test data set. Samples were obtained from bone marrow and peripheral blood 

25 of acute leukemia patients. RNA was hybridized to high-density oligonucleotide 

microarrays (Affymetrix ) with probes for 6,817 human genes. The MAD thresholding 
algorithm was applied to each of the 72 arrays with different starting percentages {q) 
of 1%, 5%, 10% and 20% (with c = 3). The resulting cutoff points at convergence 
were the same (for the various ^s) and only a few differ by negligible amounts (see 

30 Table 1, i.e.. Fig. 3). 
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An implicit assumption in developing the threshold algorithm is that small 
expression values are the noise values; however, ''small" is relative to the array. That 
is, the noise level is array specific. The question is how small is small for each array? 
The answer is the cutoff // at convergence, which separates noise values from ''real" 
5 expressed values. This depends on the parameter c, the number of median absolute 
deviations above the median (or the number of standard deviations above the mean, 
depending on which version of the algorithm is used). Increasing c corresponds to a 
more stringent standard, since expression values must be larger to be excluded from 
the noise set. Since the resulting cutoff point does not depend on q, we set q = 10% 

10 and ran the MAD thresholding algorithm for c = 2.5 and 3. The results are given in 

Figure 1. Also evident from Figure 1 is that estimates of array-specific noise are quite 
variable, therefore, it may not be optimal the use a single threshold value across all 
arrays. Figure 2 shows the expression values in a single array and the horizontal line 
is the cutoff point at convergence. 

1 5 Although the example given here consists of high-density oligonucleotide 

arrays, the threshold algorithms can be applied to cDNA arrays as well. Assume that 
after background subtraction we have intensity measurements for the red-fluorescent 
dye Cy5 and another for the green-fluorescent dye Cy3 for the /th array. One strategy 
is to apply the above procedure to each set of dye measurements separately. After 

20 separate rescaling based on separate noise estimates for each channel, one can 

proceed to analyze the log (Cy5/Cy3) (positive) measurements. The reason for the 
separate applications of the threshold algorithm to the sets of measurements from 
different channels is that noise may be channel-specific. 



confidence intervals. There are two primary approaches to this problem, an exact 
solution, and a normal or lognormal approximation. The exact solution requires 
numerical integration, as taught by Rocke and Lorenzato (1995) and will not be 
discussed here. Say we would like a 95% confidence interval for \i based on a single 
30 measurement, . The approximate method for low values of jli , {i.e., those in which 
the first term of Var()i) dominates) using an estimated variance and a normal 
approximation is: 



7. UNCERTAINTY OF A SINGLE MEASUREMENT 



25 



The uncertainty of a single measurement usually is quantified using 



/i±\. 96^ Var{}l) 



Equation 18 
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where Var(^) is estimated using: 

Var(/})= &] + fre"^' (e"^" - l) Equation 19 

which is, of course, equal to: 

Var(/7) = al + Equation 20 

5 where all estimates are obtained from the maximum likelihood routines such as those 
described in Rocke and Lorenzato (1995), or through the use of the heuristic 
estimation methods described above. For high levels of \x (/.e., those in which the 
second term in Var(^) (as set out in Equation 19) dominates, \n\x is approximately 
nomially distributed with variance a^^ . Hence a 95% confidence interval for [i is 
1 0 {exp(ln /} - 1 .96cr,^ ), exp(ln // + 1 .96(T,^ )) Equation 2 1 

Note that this interval is symmetric on the log scale, but asymmetric on the original 
measurement scale. 

We can also use this method to give confidence intervals for the average of a 
series of replicate measurements. For low levels, the average of r measurements will 

1 5 be approximately normally distributed with standard deviation ^Var(fl)/ r . For 

larger values of |i , the average of the natural log of the r measurements will have 

approximate standard deviation cr^ 1 4r , Confidence intervals can then be 

constructed as above, using the appropriate standard deviations. 

All of the references to publications, patent applications or issued patents 
20 contained in this specification are herein incorporated by reference in their entirety for 
all purposes. The foregoing description is intended to illustrate the invention, but not 
to limit it. Variations and equivalents may be practiced by those of ordinary skill in 
the art without departing from the invention, whose scope is to be limited only by the 
claims, below. 
25 REFERENCES 

1. Ash, A. A., Eisen, M.B., Davis, R. E., Ma, C, Lossos, LS., Rosenwald, A., 
Broldrick, J.C., Sabet, H. Tran, T., Yu, X., Powell, J.I., Yang, L., Marti, G.E., 
Moore, T., Hudson, J. Jr., Lu, L., Lewis, D.B., Tibshirani, R., Sherlock, G., Chan, 
W.C., Greiner, T.C., Weisenburger, D.D. Armitage, J.O., Wamke, R., Levy, R., 
30 Wilson, W., Grever, M.R., Byrd, J.C., Botstein, D., Brown, P.O., Staudt, L.M. 



21 37251 9. 1/1 9629-7006 



-14- 



Patent 

Docket No. 19629-7006 
(2000), ^^Distinct Types of Diffuse Large B-Cell Lymphoma Identified by 
Expression Profiling;' Nature, 403, 503-51 1. 

2. Alon, U., Barkai, N., Notterman, D.A., Gish, K., Ybarra, S., Mack, D., Levine, 
A.J. (1999), "Broad Patterns of Gene Expression Revealed by Clustering Analysis 

5 of Tumor and Normal Colon Tissues Probed by Oligonucleotide Arrays/' 

Proceedings of the National Academy of Sciences, 96, 6745-6750. 

3. Chem Y., Dougherty, E.R., and Bittner, M.L. (1997), "Ratio-Based Decisions and 
the Quantitative Analysis of cDN A Microarray Images," Journal of Biomedical 
Optics, 2(4), 364-374. 

10 4. DeRisi, J., Penland, L., Brown, P.O., Bittner, M.L., Meltzer, P.S., Ray, M., Chen, 
v., Su, Y.A. and Trent, J.M. (1996) "Use of cDNA Microarray to Analyse Gene 
Expression Patterns in Human Cancer," Nature Genetics, 14, 457-460. 

5. Eisen, M.B., Spellman, PT., Brown, P.O., and Botstein, D. (1998), "Cluster 
Analysis and display of Genome-Wide Expression Patterns," Proceedings of the 

1 5 National Academy of Sciences, 95(25), 14863-14868. 

6. Ermolaeva, O., Rastogi, M., Pruitt, K.D., Schuler, G.D., Bittner, M.L., Chen, Y., 
Simon, R., Meltzer, P., Trent, J.M., and Boguski, M.S. (1998), "Data Management 
and Analysis for Gene Expression Arrays," Nature Genetics, 20, 19-23. 

7. Golub, T.R., Slonim, D.K., Tamayo, P., Huard, C, Gaasenbeek, M., Mesirov, P., 
20 Collerk H., Loh, M.L., Downing, J.R., Caligiuri, M.A., Bloomfield, CD., and 

Lander, E.S. (1999), "Molecular Classification of Cancer: Class Discovery and 
Class Prediction by Gene Expression Monitoring," Science, 286, 531-537. 
8- Hilsenbeck, S.G., Friedrichs, W.E., Schiff, R., O'Connell, P„ Hansen, R.K., 

Osborne, C.K. and Fuqua, S.A. (1999), '^Statistical Analysis of Array Expression 
25 Data as Applied to the Problem of Tamoxifen Resistance," J. Natl Cancer Inst., 

91(5), 453-459. 

9. Newton, M.A., Kendziorski, CM., Richmond, C.S., Blattner, F.R., and Tsui, 
K.W., (2000), in press Journal of Computational Biology. 

10. Rock, D.M., and Lorenzato, S. (1995), ^'A Two-Component Model for 

30 Measurement Error in Analytical Chemistry," Technometrics, 37(2), 176-184. 

11. Ross, D.T., Scherf, U., Eisen, M.B., Perou, CM., Rees, C, Spellman, P., Iyer, V., 
Jeffrey, S.S., Rijin, M.V., Waltham, M., Pergamenschikov, A., Lee, J., Lashkari, 
D., Shalon, D., Myers, T.G., Weinstein, J.N., Botstein, D., and Brown, P.O. 



21372519.1/19629-7006 



-15- 



Patent 

Docket No. 19629-7006 
(2000). "Systematic Variation in Gene Expression Patterns in Human Cancer Cell 
Lines/' Nature Genetics, 24, 227-235. 



21372519.1/19629-7006 



-16- 



